Do you have any input remapping set-up ? Does it happen only on GBA games ?
Please provide the rest of the info asked in https://retropie.org.uk/forum/topic/3/read-this-first (emulator, image used for installation, etc.)